📜 Contributions by @KGBicheno at [[mini batch stochastic gradient descent (sgd)]]
Agora nodes contain community contributions with titles or topics that match your search.
📜 Artificial Intelligence/Introduction to AI/Week 3 - Introduction/Definitions/Mini-Batch_Stochastic_Gradient_Descent_(Sgd).md (contribution by @KGBicheno) ☆ 📎
mini-batch stochastic gradient descent (SGD)
Go back to the [[AI Glossary]]
A gradient descent algorithm that uses mini-batches. In other words, mini-batch SGD estimates the gradient based on a small subset of the training data. Vanilla SGD uses a mini-batch of size 1.
✨ AI Synthesis Mistral Gemini ChatGPT Claude
Expanding this section will automatically generate an AI synthesis of the contributions in this node.